Excursions and path functionals for stochastic 
processes with asymptotically zero drifts* 

Ostap Hryniv^ Mikhail V. Menshikov* Andrew R. Wade* 

6th August 2012 

Abstract 

We study discrete-time stochastic processes (X t ) on [0, oo) with asymptotically 
zero mean drifts. Specifically, we consider the critical (Lamperti-type) situation in 
which the mean drift at x is about c/x. Our focus is the recurrent case (when c is 
not too large). We give sharp asymptotics for various functionals associated with 
the process and its excursions, including results on maxima and return times. These 
results include improvements on existing results in the literature in several respects, 
and also include new results on excursion sums and additive functionals of the form 
Y2 s <t X", a > 0. We make minimal moments assumptions on the increments of 
the process. Recently there has been renewed interest in Lamperti-type process 
in the context of random polymers and interfaces, particularly nearest-neighbour 
random walks on the integers; some of our results are new even in that setting. 
We give applications of our results to processes on the whole of R and to a class of 
multidimensional 'centrally biased' random walks on M. d ; we also apply our results 
to the simple harmonic urn, allowing us to sharpen existing results and to verify a 
conjecture of Crane et al. 
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1 Introduction 

The study of functionals defined on paths of stochastic processes is a topic with classical 
foundations and extensive applications in modern probability; such functionals give a 
quantitative encapsulation of both probabilistic information about the recurrence beha- 
viour of the process and geometrical information about the way in which the process 
explores the state-space. A substantial body of work is devoted to additive functionals of 
the form £* =1 $(X S ), where X 1 ,X 2 ,... is a discrete-time stochastic process on M and 
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$ : M d — > R is a given measurable function. The most basic choice, in which is taken 
to be the indicator function l{x G A} of a Borel set A C IR d , leads to occupation time for 
A. In the most well-studied case, X t is a sum of i.i.d. random variables; the monograph 
by Borodin and Ibragimov [B] is devoted to limit theory in the i.i.d. setting. There is also 
much work devoted to the case in which X t is an ergodic Markov process. Classical work 
goes back to Markov and Bernstein (cf. [28j p. 2299]). If $ is integrable with respect to 
the stationary distribution of the process, then a large collection of 'ergodic theorems' 
and distributional limit theorems (after suitable scaling and under various conditions) are 
known, and represent an active area of research: see e.g. [10l[22J[27J[28j[33] and references 
therein for an indication of the extensive literature. 

In the present paper, we study stochastic processes on WL d of a more general type 
(assuming a regenerative property only, rather than the Markov property) and in the 
near-critical situation from the point of view of the asymptotic behaviour of the process. 
Near-criticality entails that the one-step mean drift of X t is asymptotically zero in a sense 
that we describe more precisely later on. Processes with asymptotically- zero drifts are 
of interest in their own right for exploring phase transitions in asymptotic behaviour, 
as first described in the general setting in fundamental work of Lamperti [301 [31]. A 
consequence of near-criticality is that many important distributions associated with such 
processes display heavy-tailed behaviour; these include passage times [SET] and, if they 
exist, stationary distributions j3Sj- In many cases of interest, these and other quantities 
have natural scaling exponents that depend on the details of the process. 

Moreover, such processes are important from the point of view of applications for two 
main reasons: first, they serve as prototypical near-critical stochastic systems and hence 
for the development of new techniques, and second, they can often be extracted from 
more complex near-critical systems via the method of Lyapunov functions, to powerful 
analytic effect. One classical but important illustration of the latter point is provided 
by the Lyapunov function approach to Polya's theorem on the recurrence/transience of 
symmetric simple random walk St on Z d : Polya's theorem can be understood in an 
entirely one-dimensional setting by taking X t = \\St\\, in which case the process X t has 
asymptotically zero drift in the sense that 

E[X t+1 -X t \S t = x] = elixir 1 + 0(||x||- 2 ), 

for some constant q > that depends only on d. Lamperti's recurrence classification for 
such processes [30] implies Polya's theorem. Importantly, the same technique works for 
a very large class of random walks; in particular, the Markov property is not essential. 

For these asymptotically zero drift processes, we study a class of additive functionals 
(or path integrals) of the form Y^l=i a — 0- Moreover, we study the maximum 
functional maxi< s <( X s (which corresponds in a certain sense to the a — > oo limit of the 
additive functional). We are interested in the large-t asymptotics of such functionals, in 
the case where X t is recurrent. Our primary interest is not in the case where the process 
has sufficient 'ergodicity' properties that t _1 ^ s =i ^-s converges, but rather in the case 
where Yll=i -^-s g rows faster than linearly, including the case where X t is nit//-recurrent. 
This is rather different to the emphasis of the classical work cited above, and accords 
with our focus on systems that are near-critical in some sense. 

We make some further remarks on applications and related results. Borovkov et al. [7] 
consider analogues for queueing models of the path integrals that we study. As far as 
the authors are aware, there has been little work specifically concerned with additive 
functionals of processes with asymptotically zero drift. For a particular (null-recurrent) 
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example of a nearest-neighbour random walk on the nonnegative integers, Fal' [15] proved 
distributional limits for functionals such as ^2 B=1 (1 + X S )~ 1 J 7 > sufficiently large. Our 
interest is in functionals of the opposite nature. 

A (normalization of a) particularly important path integral is the center- of -mass pro- 
cess associated with X t defined by G t = t" 1 X^ s =i^a- The behaviour of G t for Markov 
processes is only partially understood beyond the case in which sufficient ergodicity en- 
sures that Gt converges to a limit. For the centre-of-mass associated with simple random 
walk on Z d , Grill [21] proves the interesting result that (compact-set) recurrence is present 
if and only if d = 1. The desire to understand Grill's result more generally was one of the 
original motivations for the work of the present paper; by analogy with Lamperti [3"U|I3"T]. 
it is natural to begin in the setting of processes with asymptotically zero drifts. 

Our approach is via a detailed study of the excursions of the process X t , in which, 
once again, the heavy-tailed nature of the characteristics of the processes becomes evident. 
Thus, if 77 denotes the duration of an excursion, we are led to the study of excursion func- 
tionals such as Y^l=i (including the special case a = of 77 itself) and maxK S <^X s . 
As well as being key ingredients in the proofs of our large-t asymptotics, these quantities 
are of interest in their own right in various theoretical and applied contexts. For example, 
to apply Theorem 2.1 of [10] one needs to understand tail properties of an analogue of 
J^ =1 ATf; sums over excursions for processes with asymptotically zero drift turn out to 
be central to the analysis of the 'simple harmonic urn' [5] (see also Section I3T31 below) . 

In the last decade or so, significant interest in processes with asymptotically zero drifts 
has come from a community of probabilists and statistical physicists from the point of 
view of modelling the configurations of polymers and interfaces. A now standard approach 
in this field is to take as an underlying model a nearest-neighbour random walk with an 
asymptotically zero drift: see for example [UH21I22]- Such nearest-neighbour models are 
amenable to explicit calculation, often via intricate algebraic methods such as Karlin- 
McGregor spectral theory and orthogonal polynomials [26]; other recent work on these 
models, not directly motivated by polymer models, includes for example [II, 18, 29jl4T)]. 
This continued interest in asymptotically zero drift processes in the nearest-neighbour 
case is another motivation for the present paper, in which we present related results for 
a much more general class of models. We discuss the relation of our results to some of 
this recent work in more detail in Section 13.41 

The outline of the remainder of the paper is as follows. In Section [2] we give a formal 
statement of our half-line model and state our results on excursions and functionals in a 
series of subsections. In Section [3] we give applications of our half-line results to processes 
on the whole line (Section 13. 1 p and to multidimensional processes including centrally 
biased random walks on M d (Section 13.21) and the simple harmonic urn (Section 13.31) . 
Also, in Section 13. 4[ we make some remarks on how our model and results complement 
recent results, restricted to nearest-neighbour random walks, in the context of models of 
random polymers and interfaces. The proofs of the results in Sections [2] and [3] are given 
in Sections @] and \5\ respectively. 

2 Main results on path functionals 
2.1 Description of the model 

We formally describe our process X := (X t ) te ^ (N := {1,2,...}) and our structural 
assumptions on its state-space S. Recall that a subset R of M. d is locally finite if R fl H 
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is finite for all bounded H C M. d . Our basic assumption is the following. 

(AO) (a) Let S be a locally finite, unbounded subset of [0, oo) with G S. 

(b) Suppose that (X t ) t£N is an 5-valued process adapted to a filtration (Ft) ten, and 
P[Xi = 0] = 1. 

We also assume the following form of 'irreducibility'. 
(Al) Suppose that for each x,y G <S there exist m(x, y) G N and ip(x, y) > such that 
P[X t+m(Xti2/) = y | F t ] > <f(X t ,y), a.s., for all t G N. (2.1) 

If X is a time-homogeneous Markov process, (12.11) reduces to the usual sense of irreducibil- 
ity that, for any x,y G S, there exists m(x, y) G N such that P[X m ( Z)J/ ) = y | Xi = x] > 0. 
The assumption (12.11) allows us to work with more general processes, such as functions of 
Markov process: see the discussion at the end of this subsection. A consequence of (AO) 
and (Al) is that limsup^^ X t = oo, a.s.; see Proposition 12.11 below. 

We make some 'Lamperti-style' assumptions on the increments of X. Throughout we 
use the notation A t := X t +\ — X t . We will typically need to assume that for some p > 2 
(at least), some 5 > 0, and some constant C G (0, oo), for all t G N, 

E[|A t |" | F t ] < C(l + X t ) p - 2 - 5 , a.s. (2.2) 

Given that (12.21) holds for some p > 2, E[A^ | Ft] is a.s. finite for k G {1, 2}. We make 
some further assumptions on the moments of the increments, as follows. For notational 
convenience, throughout the paper we write \og q x for (logx) q , q G M. 

(A2) Suppose that for some c G M and s 2 G (0, oo), as X t — > oo, 

E[A f | Ft] = cX~ l + o(X~ 1 log" 1 X t ), a.s., (2.3) 
E[A 2 t | Ft] = s 2 + o(log" 1 X t ), a.s. (2.4) 

We make an important note on notation: our usage assumes that implicit constants in 
Landau 0( ■ ), o( • ) symbols are non-random and independent of t, so that asymptotic 
expressions such as (12.31) and (12. 4p are understood to hold uniformly in t and probability 
space elements u (on a set of probability 1). So, for example, (12 .4p means that for any 
e > we can choose x < oo so that |E[Aj? | Ft] — s 2 \ < e/logX t , a.s., on {X t > x}, for 
any teN. 

We study X via its excursions from 0. Set r := 1 and for n G N define 

T n := min{t > r n _i : X t = 0}, 

with the usual convention that min0 = oo. That is, To, t±, t%, . . . are the successive times 
of visit to the origin by X; if X visits only finitely often then r n = oo for all n large 
enough. When r n < oo we denote, for n G N, rj n := r„ — r„_i, the duration of the nth 
excursion; also set rjo := 1. Provided that r n < oo, we denote the nth excursion (n G N) 
by £ n := {X^r^KtK^-i. Let N := min{n G N : r n = oo}. 

(A3) (a) Suppose that, on {N = oo}, (£ n ) n eN is an i.i.d. sequence. 

(b) Suppose that, for all n G N, P[^ n +i < oo | r„ < oo] = P[r/i < oo]. 
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Part (a) of (A3) assumes a full regenerative structure in the case of an infinite number 
of returns to 0. Part (b) makes a weaker assumption, needed to deal with the event 
{N < 00} . A useful reference for regenerative processes is [21 Chapter VI]. 

Our irreducibility and regenerative assumptions have the following basic consequence. 

Proposition 2.1. Suppose that (AO) and (Al) hold. Then limsup^^ X t = 00, a.s. If, 

in addition, part (b) of (A3) also holds, then either: 

(i) (transience) P[r/i < 00] < 1 and lim^oo X t = 00 a.s.; or 

(ii) (recurrence) IP [7/1 < 00] = 1 and lim inf X t = a.s. 

We give the proof of Proposition 12.11 in Section 14.31 along with the proofs of the other 
results that we present in the present section. 

Before describing our main results, we indicate why we have chosen our particular 
assumptions. It is too restrictive for the applications that we have in mind to assume 
that X is itself a Markov process; our more general framework enables us to work with, 
for example, X t = \\Y t \\ where Y t is a Markov process on IR d . More generally, suppose that 
(Yt)t e N is an irreducible time-homogeneous Markov process on an arbitrary countable set 
E, and let / : E — > [0, 00) be measurable such that is finite for each x. Let 

T t = o~(Y 1 , . . . , Y t ) and take X t = f(Y t ). Then X t is J^-adapted and has the countable 
state-space S = /(E). Moreover, by irreducibility, given u and v such that f(u) = x 
and f{y) = y, there exist ip(x,y) > and m(x,y) G N such that ¥\Y t+m ^ x ^ = v \ Y t = 
u] > Lp(x,y), using the fact that, by our assumption on E and /, there are only finitely 
many possible u, v pairs for a given x, y. Hence (12.1ft holds. If / _1 (0) = is unique, (A3) 
follows from the strong Markov property. This generality is very useful for applications: 
we describe one such example in detail in Section 13.21 below. 

The remaining parts of this section are devoted to our results. Our excursion-based 
approach is only applicable in the recurrent case, so first we give a recurrence classific- 
ation. Then we move on to detailed properties of excursions and the tails of associated 
random variables, and finally to t — > 00 asymptotics of functionals defined on paths of 
the process up to some given time t. We exhibit various tail or scaling exponents for the 
quantities that we study; we remark that the relationship amongst the various exponents 
is not always correctly predicted by naive heuristic arguments. 

2.2 Recurrence classification 

We say X is transient if P[r/i < 00] < 1; otherwise it is recurrent. If recurrent, we say that 
X is positive-recurrent if E[r/i] < 00 and n?j//-recurrent if E[r/i] = 00. Under (A2), the 
quantity — 2c/ s 2 will play a central role in all that follows, and we introduce the notation 

r := -2c/ s 2 . (2.5) 

The recurrence classification for X is as follows. 

Theorem 2.1. Suppose that (AO) -(A3) hold, and HTE) holds with p > 2. Then X is 

(i) transient if r < —1; 

(ii) null-recurrent if —1 < r < 1; 
(Hi) positive- recurrent ifr>l. 
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Theorem 12 .11 is essentially due to Lamperti [30|f3Tj (in the case \r\ ^ 1) and Menshikov 
et al. [3l] (in the case \r\ = 1) under somewhat different conditions. We do not give a 
detailed proof of Theorem 12.11 here, but sketch in Section 14.31 how these existing results 
may be adapted to our setting. 

2.3 The maximum of an excursion 

Let M n := max rn l <( <rii X t , the maximum attained by S n . The next result gives tail 
bounds, in the recurrent case, for the (M n ) ng ^, which are i.i.d. under our assumptions. 

Theorem 2.2. Suppose that (A0)-(A3) hold. Suppose that r > —1 and \2. I| ) holds with 
p > max{2, 1 + r}. Then for any e > 0, for all x sufficiently large, 

ar 1_r (logx)- e < P[Mi >x}< x~ l ~ r (\ogx) l+£ . (2.6) 

In particular, E [M 1 1+r ] = oo but, for any e > 0, E [M 1 1+r_e ] < oo. 

Remarks 2.1. (a) Symmetric simple random walk on the half-line with reflection at 
(and, indeed, any of a host of more general zero-drift models) has r = 0, and is thus 
right on the boundary of having a finite expectation for Mi . (b) In the tail bound h2.6\) 
and similar results in the sequel, the polynomial term is sharp but we do not necessarily 
strive for the best possible logarithmic term. Our results are all sharp enough, however, to 
classify completely which moments do or do not exist for the random variable in question. 

2.4 The duration of an excursion 

The following result is a sharpening in our context of [51 Propositions 1 and 2], which 
themselves extended work of Lamperti [31] . 

Theorem 2.3. Suppose that (A0)-(A3) hold. Suppose that r > — 1 and \2.2\) holds with 
p > max{2, 1 + r}. Then for any e > 0, for all x sufficiently large, 

x'^logx)" 2 < Pfai >x}< ^"^(logx) 2 ^^. (2.7) 

l+r 1+r 

In particular, E^ 2 ] = oo but, for any e > 0, E^ 2 ] < oo. 

The existence of moments for t]i part of Theorem 12.31 is based on general results 
of [1]. The non-existence of moments result is new in the generality given here; under 
more restrictive assumptions (including uniformly bounded increments for X t ) it can 
be derived from [3j Corollary 1]. Our proof of the non-existence result is based on the 
intuitively appealing Lemma 14.111 below. Lamperti [31] was the first to systematically 
study the problem of the existence or non-existence of moments E[r/*]: his results covered 
only integer q. Subsequently Aspandiiarov et al. extended Lamperti's results to all q > 
(see the Appendix of [5]), but neither [HT] nor the results of [S] determine whether the 
boundary case E[7/ 1+r )/ 2 ] is finite or infinite; as mentioned above, results of [3] can be 
used to settle the boundary case, but under more restrictive conditions on the increments 
than we use in Theorem 12.31 (The results of [5l|31] related to Theorem 12.31 are stated in 
the Markovian setting, but their methods, similar to ours, work more generally.) 
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2.5 Number of excursions 

Let N t denote the number of excursions up until time t, i.e., N t := max{n G N : r n < t}. 
Theorem 2.4. Suppose that (AO)- (A3) hold. 

(i) Suppose that — 1 < r < 1 and K2.2) holds with p > 2. Then for any e > 0, a.s., for 
all but finitely many t, 

t 1 ^ (\ogt)- 3 - r ~ £ <N t < t 1 ^ (logt) 1+£ . (2.8) 

(ii) Suppose that r > 1 and \2. I| ) /io/ds luz't/i p > 1 + r. T/ien a.s. ; as t — >■ oo ; t~ x N t — > 

E[77] G 

2.6 Occupation times and stationary distribution 

In this section E[?yi] < oo. Define for t G N and x G S the occupation times L t (x) := 
^21=1 = x }- Also define the occupation times during the nth excursion by 

£ n (x):= HXt = x}. (2.9) 

t=T n -l 

The next result is essentially a consequence of 'ergodic theory' for regenerative processes. 
The limiting distribution ir that appears in Theorem 12.51 is the usual (unique) stationary 
distribution if X is an irreducible positive-recurrent Markov process. 

Theorem 2.5. Suppose that (AO) -(A3) hold, r > 1, and Ii2.2\) holds with p > 1 + r. 
Then setting 

*>-W- (2 - 10) 

we have that ir(x) > 0, J^xes 71 ^) = ^> an( ^' f or anv x ^ S, t~ 1 L t (x) — > rc{x) a.s. and in 
L q for any q > 1 . Finally, if, in addition, the distribution of rji is not supported on kN 
for any k > 1, we have that, for any x G S, lim^oo ¥[X t — x\ — tt(x). 

Remark 2.1. In the case of a Markov process with uniformly bounded increments, under 
assumptions otherwise similar to ours, results of Menshikov and Popov 131% show that, for 
r > 1, ir(x) = x~ r+ °^ as x — >• oo. The asymptotics of ir(x) are not of direct interest to 
the topic of the present paper, and so we do not discuss this further here, but our methods 
can be used to extend such results to the present more general setting. 

2.7 Running maximum process 

In this section we consider the process of maxima of X, i.e., maxK^; X s . 

Theorem 2.6. Suppose that (A0)-(A3) hold. 

(i) Suppose that — 1 < r < 1 and \2. 2\) holds with p > 2. Then for any e > 0, a.s., for 
all but finitely many t, 

t^(logt)"^" £ < maxl s < t^(logt)^ +e . 

Ks<i 
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(ii) Suppose that r > 1 and ( II?. 2\) holds with p > 1 + r. Then for any e > 0, a.s., for all 
but finitely many t, 



1 1 , , 2 



t 1 + r (fog t) 1+r 6 < maxl s < t 1+r (log t) 1 + 



Ks<i 



Remarks 2.2. (a) Related bounds in a general Lamperti-type setting are given in l3B[ Sec- 
tion 4]; the excursion-based approach adopted here has both advantages and disadvantages 
compared to the method of iWj - The upper bounds in Section 4 of I3l)tf essentially apply 
in the present setting (concretely, use fSfil Theorem 3.2] with Lemma \J^1\ here ), and lead 



to slightly sharper upper bounds than those in our Theorem \2.b\ (See also Section 6 of JBj 
for some variations on these upper bounds.) However, the lower bounds in ISUtf cannot 
readily be applied here, even assuming a uniform bound on the increments of X t . Thus 
our lower bounds in Theorem \2. 61 represent progress over previous results. 

(b) Our excursion-based approach sheds no light on the transient case r < — 1. For 
r < —1, under several additional assumptions, f3h\ Theorem 4-2] shows that there exists 
D E (0, oo) such that a.s., for all but finitely many t E N, X t > t 1//2 (logi) _D . This 
result can be viewed as a generalization of the classical Dvoretzky-Erdds theorem on rate 
of escape of transient simple symmetric random walk in Z d (d > 3) f?3] /. 

(c) In various special cases of certain nearest-neighbour random walks on Z + , using 
methods restricted to the nearest-neighbour case, sharper versions of one or other of the 
bounds in Theorem \2~Wi) are given in fTo] ll8 [ l2^ [\37[l38[ \4Uii ; of these, only J2B$ also has 
a version of Theorem \2.bY ii). 

2.8 Single-excursion sums 

For a > and n E N set 

ei a) := X- = J2^^(x), (2.11) 

i=T n _i x£S 

with the occupation time notation of (I2.9P ; note that £^ = rji. Our next result gives 
tail bounds for £[ a \ Theorem 12.71 has applications in its own right: for example in [T0| 
Theorem 2.1, p. 908] one is required to verify a condition similar to E[(£j°^) 2+5 ] < oo. 

Theorem 2.7. Suppose that (A0)-(A3) hold. Suppose that r > — 1 and \2.2\) holds with 
p > max{2, 1 + r}. Let a > 0. Then for any e > 0, for all x sufficiently large, 

x -s+2(l og x)- £ < P[£j aJ > x] < x~^(\ogx)^ +1+£ . (2.12) 

In particular, E[(£^)^+2] = oo but, for any e > 0, E[(^ Q ' ) )^+2~ e ] < oo. 

Remarks 2.3. (a) The a = case of Theorem\2. 7| reduces to Theorem \2.3[ Theorem\2. 7 



can also be seen as a generalization of Theorem \2.2\ since here lim Q ,_ >00 (^ a ^) 1//a = M\, 
a.s., so for any x, P[£i > x a ] —> P[Mi > x] as a — > oo. 

(b) For simplicity we have stated our results for functionals based on x h- >■ x a , but our 
methods apply to any nonnegative nondecreasing function (cf Lemma \4.11\ below). 
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2.9 Path integrals 

Fix a > and define := ^* =1 Xf. We have the following asymptotic results on Sj: a \ 
Theorem 2.8. Suppose (AO) -(A3) hold, r > —I, and 12.2) holds withp > max{2, 1 + r}. 
(i) Suppose that — 1 < r < 1. Then for any e > 0, a.s., for all but finitely many t, 

a + 2 , (a + 2)(4+r) , \ q+2 , 3a + 6 , n , 

t~2-(iogt) ~ — e < sr < t— (\ogt)— +2+e . 

(ii) Suppose that 1 < r < 1 + a. Then for any e > 0, a.s., for all but finitely many t, 

a+2 , , a+2 _ a+2 , . 2q+4 . . _ 

t— (logt)-— " e < S t (a) < t— (logt)— +2+£ . 
(Hi) Suppose that r > 1 + a. Then, with tt as defined at 112.10]) . as t — > oo, a.s., 

r 1 ^ -> = J3x-7r(x) =: i/ a 6 (0,oo). (2.13) 

Theorem I2.8( iii) is essentially a consequence of 'ergodic theory' for regenerative pro- 
cesses (see e.g. (2J Theorem VI. 3.1, p. 178]) but our proof of Theorem |2.8f i)-(ii) yields 
part (iii) at little additional effort, so we give the self-contained proof in Section H~3"l 

A case of special interest is when a = 1, in which case it is natural to study the 
normalized sum t~ x St which is just the centre of mass of (X l5 . . . , X t ). Denote 

t 

G t :=r x sl x) =r l Y,*s- (2-14) 

s=l 

Theorem 12.61 yields the following immediate corollary for Gt- For simplicity of presenta- 
tion, we suppress the logarithmic factors in Theorem 12.61 by stating Corollary 12.11 parts 
(i) and (ii) on the logarithmic scale. 

Corollary 2.1. Suppose (AO) -(A3) hold, r > —1, and $2.21) holds withp > max{2, 1+r}. 
(%) Suppose that — 1 < r < 1. Then lim^oo = | ; a.s. 

(ii) Suppose that 1 < r < 2. Then lim^ = ge[0, 1/2), a.s. 

(iii) Suppose that r > 2. Then for V\ G (0, oo) given by 112.13]) . lim^oo G t = u x , a.s. 

Remark 2.2. Comparing the scaling exponents in Corollary \2.1\ to those in Theorem 
\2.6\ we see that they coincide (taking value \) in the null-recurrent case, but differ in the 
positive-recurrent case (j^ < -A^ for r > 1). The intuition here is that in the positive- 
recurrent case, the process rarely visits the scale of the maximum, so Gt <C maxi< s < t X s . 
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3 Applications 



3.1 Processes on the whole real line 

In this section we give applications of our results from Section [2] on half-line processes to 
models defined on the whole line, for which new phenomena emerge. We restrict to the 
Markovian case for simplicity of statement. The R-valued processes that we study are, 
loosely speaking, two half-line processes sewn together at 0. 

(BO) Let (XtjteN be an irreducible, time-homogeneous Markov chain on S, a locally finite 
subset of R with G S, inf S = — oo, and sup5 = +oo. Take X\ = 0. 

(Bl) Suppose that P[X t+ i = y \ X t — x] = if x and y are separated by 0. Suppose also 
that F[X t+1 < | X t = 0] G (0, 1) and P[X m > | X t = 0] G (0, 1). 

Under (Bl), X t cannot jump over the origin, and from the origin jumps left or right 
each with positive probability. As above, write A t := X t+1 —X t for the increments of X t . 

(B2) Suppose that for somep > 2 and 5 > 0, E[|A f | p \ X t = x] = 0(|x| p ~ 2 ~ 5 ) as \x\ -»■ oo. 
Suppose also that for some c+, c_ G R and s+, s 2 . G (0, oo), 

E[A t \X t =x} = (c+l{x > 0} -c_l{x < 0}) + o(|x|^ 1 log" 1 |x|), (3.1) 
E[A 2 \X t = x] = (s 2 + l{x > 0} + s 2 l{x < 0}) + oQog- 1 |x|). (3.2) 

Analogously to the definition of r at (j2.5j) . set r± := —2c±/s±. In this section we 
restrict to the setting in which r_,r + G (—1,1], i.e., corresponding to null-recurrence 
of each of the half-line processes. Cases where one or more of r_,r + is greater than 1 
can be dealt with using similar methods. We assume that — 1 < r + < r_ < 1, so that 
the positive half-line is 'less recurrent'. The following result demonstrates the interesting 
phenomenon of a separation of scales for the two sides of the process. 

Theorem 3.1. Suppose that (B0)-(B2) hold, and that — 1 < r + < r_ < 1. Then X t is 
null-recurrent, and, a.s., 

-, and 

As a concrete example, consider a nearest-neighbour random walk on Z which jumps 
as a symmetric simple random walk when on the nonnegative integers, but from x < 
jumps to x ± 1 with probabilities | ± j-. Then r + = and r_ = 1; viewed separately 
the two half-line process are null-recurrent and have the same (diffusive) scale, but the 
'combined' process has scales t 1 ! 2 on [0, oo) and i 1 / 4 on (— oo,0]. 

The intuition behind Theorem 13.11 is that the walk makes a comparable number of 
positive and negative excursions, but the positive ones have heavier-tailed durations, so 
occupy a dominant proportion of time. The same intuition is behind the next result, 
which shows that the positive sojourns dominate the path-integral asymptotics. Again 
we use the notation (I2.14p . now for X s taking values in R. 



logmaxi< s <t X s 
hm — 

t->oo log t 

log | mini< s<t X s \ 
iim — 

t->oo log t 
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Theorem 3.2. Suppose that (B0)-(B2) hold, and — 1 < r + < r_ < 1. Then, a.s., 
Gt —> +oo and 

r logG* 1 
lim — = -. 

t^oo log t 2 

Remarks 3.1. (a) We leave largely open the case r + = r_ ; but see the d = 1 case of 
the model in Section \3~2\ (b) Similar results to those in this section can be obtained for 
processes on a state space that consists of multiple copies of [0, oo), joined at a common 
origin, and embedded in M. d . 

3.2 Centrally biased random walks on M. d 

In this section we work in M. d , d G N. For x G M. d , write x = (x\, . . . ,Xd) in Cartesian 
coordinates. Let || • || denote the Euclidean norm on For a non-zero vector x G M. d we 
write x := x/||x|| for the corresponding unit vector. Write := (0, . . . , 0) for the origin. 

(CO) Let 5 = (£t)t e N be an irreducible, time-homogeneous Markov process whose state 
space E is an unbounded, locally finite subset of M. d containing 0. Let £i = 0. 

We use the notation 9 t := £ t+ i — £ t for the increments of the walk. The assumption 
(CO) implies that the distribution of 9 t depends only on the position £j G E and not on 
t. We assume that for some p > 2, 5 > 0, and C < oo, 

E[||0 t f|& = x] <C(l + ||x||r 2 - 5 . (3.3) 

Denote the one-step mean drift vector p(x) := K[9 t \ £ t = x] for x G E, and denote 
the covariance matrix at x G S by M(x) := (M i j(x.)) i j := K[8j9 t \ £ t = x], for x G E, 
where 8 t is viewed as a row-vector. In vector equations such as the equation for yu(x) 
in the following assumption, an expression of the form o(/i(||x||)) is to be interpreted a 
vector whose components are each o(/i(||x||)) as ||x|| — > oo, uniformly in x given ||x||. 

(CI) Suppose that there exist p 6 1 and a 2 G (0, oo) for which, as ||x|| — > oo, 

Mx) = pxHxH- 1 + ofllxU^log- 1 ||x||), 
M ii (x) = a 2 l{z=j} + o(log- 1 ||x||). 

The assumption on M in (CI) implies that ^ has an asymptotically diagonal cov- 
ariance structure. Processes satisfying (CO) and (CI) were studied by Lamperti [30|l3~T] 
under the name centrally biased random walks, due to the nature of the drift field; the 
name had been used earlier by Gillis [20] for a different model. Our main result on such 
models is the following, which will enable us to apply the results of Section |2] to generalize 
and sharpen Lamperti's results, among other things. 

Theorem 3.3. Suppose that (CO) and (CI) hold, and A3. 3\) holds for some p > 2. Let 
X t = ||£ t ||. Then X t satisfies the conditions (A0)-(A3), with 

c = p+ (d- l)(a 2 /2), s 2 = a 2 ; 

hence r = 1 — d — (2p/o~ 2 ). Moreover, A2. 2\) holds for the given p > 2. 
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From Theorem I3.3[ we immediately deduce a series of results for 5 from the theorems 
in Section [2] We state two such corollaries. Note that if we set r\ := min{t e N : (j = 0}, 
we have from (CO) that rj = rji for X t = ||£t|| in our previous notation, since Xt — if 
and only if £ f = 0. Theorem 13.31 with Theorems 12.11 and 12.31 gives the following result. 

Corollary 3.1. Suppose that (CO) and (CI) hold, and 113. 3\) holds with p > 2. Then H is 

(i) transient if2p/a 2 > 2 — d; 

(ii) null-recurrent if —d < 2p/a 2 < 2 — d; 
(Hi) positive- recurrent if2p/a 2 < —d. 

Moreover, in the recurrent cases, E,[r] q ] < oo if and only if q < qo := 1 — (d/2) — (p/a 2 ). 

Corollary 13.11 extends results of Lamperti [HDHS], who assumed uniformly bounded 
increments for £ t and a stronger version of (Bl) with the error term log - ||x|| replaced 
by ||x|| -<s for 5 > 0: see Theorem 4.1 of [301 p. 324] and Theorem 5.1 of [311 p. 142]. Also, 
Lamperti's result only covers integer q, and is not sharp enough to determine whether 
E[?7 90 ] is finite or infinite, and so cannot decide on null- or positive-recurrence at the 
boundary case 2p/a 2 = —d. 

The next result follows from Theorem 13.31 with Theorem 12.61 and gives almost-sure 
scaling behaviour for the maximum of ||^|| in the recurrent cases. 

Corollary 3.2. Suppose that (CO) and (CI) hold. 

(i) Suppose that —d < 2p/o~ 2 < 2 — d and \3.3\) holds with p > 2. Then 

logmaxi< s<t H^ll 1 

hm = -, a.s. 

t^oo log t 2 



(ii) Suppose that 2p/o~ 2 < —d and \3. 3\) holds with p > 2 — d — (2p/o~ 2 ). Then 

logmaxi< s<f ||f s || 1 

hm = — ; -— -, a.s. 

t^oo log* 2- d- (2p/a 2 ) 



Upper bounds similar to those in Corollary I3.2l can be derived from [361 Section 3]: see 
Theorem 2.4 of [8] for a similar application of such results, albeit under more restrictive 
assumptions. As far as the authors are aware, the lower bounds in Corollary 13.21 are new. 



3.3 The simple harmonic urn 

In this section we study a particular Markov chain (At, B t ) on Z 2 \ {(0, 0)}, with discrete 
time t G N. The model was introduced in [Hj, motivated by an urn model. The model 
takes as input the distribution of a Z- valued random variable k. We assume that, for 
some A > 0, E[e A ' K '] < oo. Let kq, ki, . . . be a sequence of independent copies of k. The 
transition law of the chain is as follows. If A t B t ^ 0, i.e., the chain is not on one of the 
coordinate axes, it takes jumps of unit size according to the following: 

P [(A t+1 , B t+1 ) = {a,b + sgn(a)) | (A t , B t ) = (a, b)] = f^-r , {ab jt 0); 
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P [(A t+1 , B t+1 ) = (a - sgn(6), b) \ (At, B t ) = (a, b)] = j^fj^y (ab ± 0), 

where sgn(x) := xj\x\ for x G M\{0}. From one of the axes, the process jumps as follows: 

(A t+1 , B t+1 ) = (sgn(A) max{l, \A t \ - sga(A t )), (A t ^0,B t = 0); 
(A t+1 , B t+1 ) = (- sgn(B t ), sgn(£ t ) max{l, \B t \ - K t }), (A t = 0,B t ^0). 

In words, the process has an approximately anti-clockwise trajectory, traversing each 
quadrant in sequence. When not on an axis, the process traverses the current quadrant 
using unit steps in two possible directions, while from an axis, the process moves one 
step away from the axis (in the anti-clockwise direction) and makes a special jump of size 
distributed as k towards the next destination axis, truncating so as to ensure it does not 
actually reach the next axis in this jump. 

So defined, (A t , B t ) is an irreducible Markov chain on Z 2 \ {(0,0)}. 

The basic case has k = a.s., in which case the process is the simple harmonic urn; 
another particular case has k = 1 a.s., which is known as the leaky urn [9]. The general 
k model is known as the noisy urn [9J. In fact, the leaky urn in [9] was defined slightly 
differently, with an absorbing state when \A t \ + \B t | = 1, but the two definitions coincide 
up until the time of absorption. 

Let uq := and, for n G N, v n := min{t > z/ n _x : A t B t = 0}, so that Ui, u 2 , . . . are 
the successive times of visits to the axis by the process (A t ,B t ). Define the embedded 
process Z t := \A Ut \ + \B Ut \ for t G N; by construction, exactly one of \A Ut \ and \B Ut \ is 0. 
Then Z t is an irreducible Markov chain on N, representing the distance of the original 
Markov chain from the origin at those times when it visits an axis. For definiteness, we 
take (A u Bi) = (1,0), so Z l = 1. 

The following result shows the connection between this model and our present setting. 

Proposition 3.1. Let X t = V ' Z t - 1. Then (AO)-(AS) hold with S = {Vx~^T : x G N} ; 
c = 1 " 2 4 E M ? an d s 2 = i- hence r = 6E[ac] — 3. In addition, \2. S\) holds for any p > 0. 

Proposition 13.11 is closely related to Lemma 7.7 in [9], but differs slightly as our 
embedded process Z t is not quite the same as the one used in [9], so we sketch the proof 
in Section 15.31 below. For the original process, we are interested in r := min{t G N : 
\A t \ + \B t \ = 1}. For our embedded process, define r q := min{£ G N : Z t — 1} (where 
the 'g' indicates 'quadrant time'). The key relationship between the two processes is that 
t = v Tq , since | A t | + | B t \ = 1 if and only if t — v^. for some k and Z k — 1. In [9J , a slightly 
different version of the embedded process Z t (namely, Z^ defined on p. 2125 of [9]) was 
used; for that version the analogous claim to ! r = v Tq ^ made just below equation (6) in [9] 
is not correct as stated, although this has no impact on the results in [9]. It is not hard 
to fix this small gap in the argument in [9J, and the variation given in the present paper 
is just one way of doing so. More importantly, the results of the present paper enable us 
to sharpen the results in [9] and to settle a conjecture made in that paper. 

Proposition 13. II enables us to determine the tails of r q ; some additional work is needed 
to account for the change of time between (A t ,B t ) and X t and hence study the tails of 
t = v T . Due to the special structure of the paths of the simple harmonic urn process, it 

(2) 

turns out that exactly relevant to this point is an excursion sum of the type £! defined by 
(12. lip . We prove the following result in Section IBTBl The condition E[k] > | corresponds 
to r > —1, in which case the process is recurrent. 



13 



Theorem 3.4. Suppose that E[k] > |. Let p > 0. T/zen E[r p ] < oo if and only if 
p < 3E ^~ 1 . In particular, the Markov chain (A t , B t ) is null- recurrent when E[ac] = 1. 

This result shows that E[r p ] = oo for p = 3E ^~ 1 , the boundary case not covered by 
Theorem 2.6 of [9]; the fact that the process is nw/Z-recurrent when E[k] = 1 confirms the 
conjecture after Corollary 2.7 in [9]. Theorem 13.41 has the following immediate corollary, 
which fills the gap in Theorem 2.3 of [9]. 

Corollary 3.3. For the leaky urn, the time to absorption is non-integrable. 

3.4 Random walk models of polymers and interfaces 

The last decade or so has seen renewed interest in one- dimensional random walks with 
asymptotically zero drifts from a statistical physics perspective, concerning models of 
random polymers and interfaces, their structure, and their interactions with a medium 
or boundary. In the context of random polymers, the path of the process models the 
physical polymer chain; the asymptotically zero drift indicates the presence of long-range 
interaction with a boundary, which can be either attractive or repulsive. For a random 
interface, the walk models the behaviour of a liquid interface on a solid substrate (includ- 
ing wetting and pinning phenomena); in this context the drift may represent affinity for 
the boundary. We refer to [19],[22l[39] for recent surveys. 

Much of the existing work is restricted to nearest-neighbour random walks on Z + , 
where explicit calculations are facilitated by reversibility and associated algebraic struc- 
ture (such as Karlin-McGregor theory [26]); see e.g. [T}[T2|I23] for models inspired directly 
by random polymers, and e.g. [TTI[T5} |4"0"] for related work. In this section we make some 
brief remarks emphasizing how the present paper adds to this literature, and in particu- 
lar how our results can be used to study quantities of interest in this context for a much 
more general class of processes; our results not only do not require the nearest-neighbour 
assumption, but do not need bounded jumps or even the Markov property per sc. 

A typical family of nearest-neighbour random walks X t on Z + that has been extens- 
ively studied has W(X t+ i — X t ± 1 | X t = x) = ~ =p ix & +25 f° r ^ > and a parameter 8; here 
(A2) holds with c = —5/2 and s 2 = 1, so r = 5. This and closely related models were 
considered by Karlin and McGregor [26], and by many subsequent authors, including 
for instance [TlHTBl fTS I 1371 1351 14"0] and, most recently [12] and [23]. In these very special 
cases, FaF [2] gives asymptotics for excursion times and the number of excursions (cf our 
Theorem I2.4p . while several authors [H^IIElEIlEEllin] gi ve iterated-logarithm type upper 
bounds in the diffusive case (cf our Theorem I2.6f i)). Huillet [23] gives sharper versions 
of our Theorems 12. 2\ 12. 3[ and 12.61 in this special case: see Propositions 2, 9, 10, and 11 
of [23]. The main result of [12] (see also Proposition 15 of [23] ) is that, for 5 G (1,2), 
E[XJ ~ Kst l ~z, being one possible measure of the spatial extent of the polymer. Per- 
haps more natural (certainly more readily interpreted in terms of path properties) are the 
quantities maxK S < ( X s and t" 1 Yll=i X s that we study in the present paper; their scaling 
exponents for the case 5 G (1, 2) are (our Theorem 12.61 or Proposition 10 of [23J) and 
f=| (our Corollary El]) respectively. Note that for S G (1, 2), ^ > 1 - f > f=f . Alex- 
ander [T] calls such nearest-neighbour random walks with drift 0(l/x) at x 'Bessel-like', 
and gives sharp results on the asymptotics of return times, among other things. There 
seems to have as yet been no success in applying the methods of [HdSlEI] beyond the 
nearest-neighbour setting. 
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4 Proofs of main results 



4.1 Lyapunov functions 

For 7, v G K. we define the function / 7iI/ : [0, oo) — > [0, oo) by 

f^ v ( x ) := ( e + x) y \og u (e + x). 

Our basic analytical method will be built on the fact that f^^(X t ) is a submartingale 
or supermartingale, for X t outside some bounded set, for appropriate 7 and v. The 
following result is fundamental. The idea here is not new, although the particular form 
of the result is a little different from previous versions in the literature. Recall that in 
expressions such as (j4.1j) . the o(l) term is uniform in t and u. 

Lemma 4.1. Suppose that (AO) and (A2) hold, r > — 1, and (2.2) holds for some 
p > max{2, 1 + r}. Then for any y£l, as X t — > oo, a.s., 

E[f 1+r>1/ (X t+1 ) - f l+r AXt) I H = {u(l + r)(s 2 /2) + o(l)) X^ 1 log^ 1 X t . (4.1) 

In particular, for any v > 0, there exists A < 00 snc/i that, on {X t > A}, a.s., 

E[f 1+r , u (X t+1 ) - h +r ,v{X t ) I T t \ > 0; 
E[f 1+r> ^(X t+1 ) - h +T ,-u{X t ) I T t ] < 0. 

Before proving Lemma |4TT| we state a technical result. For e G (0, 1), let E e (t) denote 
the event {\A t \ < (1 + Xf) 1 ^ 6 }. Denote the complementary event by E°(t). 

Lemma 4.2. Suppose that (2.2) holds with p > 2 and 5 > 0. Taen /or some C G (0, 00) 
and any e G (0, ^), /or any g G [0,p], E[\A t \n m) \ JF t ] < C(l + X^ 2 " 5 , a.s. 

Proo/. For q G [0,p], |A t |*l £ c (t) = |A^|A t |^l B c (t) < | A t |* (1 + X t ) (1 - £)(<? - p) , by defini- 
tion of E e (t). Taking expectations and using (12. 2p we obtain 

E[\A t \n m) I Ji] < C(l + Xt ) p " 2 -' 5+(1 ^ )(9 " p) , 

and the result follows. □ 



Proof of Lemma \4-l\ Let 7 > and vGl. Take e G (0, 1). We estimate the expected 
increment of f ljU (X t ) using a Taylor expansion on E e (t), while we use Lemma 14.21 to 
control the expectation on E^(t). Differentiation of / 7)i , with respect to x gives 

Z^O) = 7(7 - l)/ 7 -2,i/(a?) + K 2 7 - l)/ 7 -2,i/-i(a;) + v(v - l)/y_2,i/-2(a:); 
and f!i' v {x) = 0(x 7-3 log^ x). Thus Taylor's formula implies that 

(/ 7>I/ (X t + A t )-/ 7l „(X t ))l Mt ) 
= A t l Ee(t) / 7 _ 1)l/ _ 1 (X t )( 7 log(e + X t ) + 1/) 

+ Afl 2 ge(f) / 7 - 2 ,,- 2 (X t ) (7(7 - 1) log 2 (e + X t ) + 1/(27 - 1) log(e + X t ) + u(v - 1)) 
+ 0(|A t | 3 l ££W X7- 3 log^X f ), (4.2) 
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as X t — > oo. Since |A f |l^ £ (t) = 0(X] 6 ), here we have that 
E[\A t \ 3 l E£(t) xr 3 \og v X t | JT t ] < E[\A t \ 2 | F t ]0(Xr 2 - £ log»X t ) = 0(X7" 2 - (e/2) ), a.s, 

by ( 12. 4p . On the other hand, since ( 12. 2 p holds for some p > 2, we have from the q G {1,2} 
cases of Lemma [4.21 that, for e > small enough, a.s., 



E[A t l Ee{t) \T t }=E[A t \T t } + 0(X, 



-l-sy 



E[Ail E6(t) \ Ft] = nA 2 t \ F t ] + 0(X- 
Taking expectations in ( 14. 2 p and using ( 12. 3 p and (12. 4p we obtain, for e > small enough, 
E[(/ 7 ,„(*, + A,) - MX,)) l E , (t] | T t \ 

= 7 (c + log" X, + , (c + + »(!)) *T log- X„ (4.3) 

as Xf -)• oo. On the other hand, for any e' > there exists C < oo for which 

\f Jt „{X t + A t ) - f J>v (X t )\ < C(l + + C| A t r +£ '. 

Hence E[\f y>v (X t + A t ) - / 7jl/ (X t )| l E ^t) I ^t] is bounded above by 

C(l + X t )^'P[£ e c (t) | Ji] + CE[|A^ +£ 'l B|(t) | 

For £ > small enough, both terms on the right-hand side here are 0(X^ +£ _2_£ ), by the 
g = and q = 7 + e' cases of Lemma 14.21 respectively, the latter case being applicable 
provided (12. 2p holds for p > 7 and taking e' G (0,p— 7). Taking e' small enough (e' < e/2, 
say) and combining this last estimate with (14. 3p we obtain, as X t — > 00, 



E[f J)V (X t + A t ) - f 7) „(X t ) I T x 



7 I c + xr 2 log' X t + u(c+ (27 - 1)S2 + 0(1)") log- 1 X t , (4.4) 



provided (12. 2p holds for p > 7. With the choice 7 = l + r = l — (2c/ s 2 ), (14. 4p implies 
( 14. ip since (c + (27 — l)(s 2 /2)) = (1 + r)s 2 /2 for this choice of 7. Since r > — 1 and 
s 2 > 0, the right-hand side of ( 14. ip has the same sign as u, for all X t large enough, and 
the conclusion of the lemma follows. □ 

4.2 Technical lemmas 

We need some results on sums and maxima of i.i.d. random variables; first, maxima. 
Lemma 4.3. Let £1, C21 ■ ■ ■ be i.i.d. ^-valued random variables, 
(i) Suppose that, for some 9 G (0, 00) and <fi G M., 

lim sup (2 (logx)~<¥[Ci > x\) < 00. (4.5) 

For any e > 0, a.s., for all but finitely many n, maxi<j< n £j < n^(logn)^~ +e . 
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(ii) Suppose that, for some 9 G (0, oo) and <j) G R, 

liminf(x 9 (logx)~^P[Ci > x}) > 0. (4.6) 

For any e > ; a.s., for all but finitely many n, ma,Xi<i< n Q > (logn)^e £ . 
Proof. First we prove part (i). From ( 14. 5p . for some C G (0, oo) and all x large enough, 

P 



max Ct < x = TTP [0 < x] > (1 - Car fl (logx)*Y 

. l<i<n J 



i=l 



Set x = n l l e (\ogn) q for some g£l. Then, for C G (0, oo), 

pfn) := Pf max > n 1/e (logn) f/ l < 1 - (l - C'rT 1 (log n)^" 9 (l + o(l)))" 

. l<j<71 J 

= 0(1 A(logn)^ 9 ). 

Take q > (<p+l)/8. Then ^ fcgN J5(2 fe ) < oo. Hence the Borel-Cantelli lemma implies 
that a.s., for all but finitely many k G N, max 1<i<2 fc 

Ci < (2 fe ) 1/9 (log2 fc ) 9 . For any n > 2, 
2 fcn < n < 2 hn+1 for some fc n G N; hence, a.s., for all but finitely many n G N, 

max Q < max Ci < (2 fc " +1 ) 1/e (log2 fc " +1 ) 9 < Cn 1/e (logn) 9 , 

l<j<n l<i<2 fe n+ 1 

where C < oo does not depend on n. Thus we obtain part (i). 

Now we prove part (ii). We have from (14.61) that for some c > and all x large 
enough, P[£i > x] > cx (logx)^, so that P [maxi<i< n C% < x] < (l — cx~ e (log x)^) . 
Taking x = n 1 / 6 (\ogn) q we obtain 

P[ max Q < n 1/9 (logn) q ] < (l - en" 1 (log n)^ 9 (l + o(l))) n 

. l<i<n J 

= O (exp (-c(logn)^(l + o(l)))) , 

which is summable over n > 2 if g < ((f) — 1)/ 6; now use the Borel-Cantelli lemma. □ 

The next result deals with sums of i.i.d. nonnegative random variables. 
Lemma 4.4. Let Ci, C2, ■ ■ ■ be i.i.d. [0, oo)-valued random variables. 

(i) If for some 6 G (0, 1) and G R, |^.5| ) holds, then, for any e > 0, a.s., for all but 



0+1 



finitely many n, Y^=i ^ — ne fl°g n 

(ii) If, for some 9 G (0, 00) and (p G R, ( l^-^P holds, then, for any e > 0, a.s., for all but 
finitely many n, Y^i=id — ne (\ogn)~ 6 . 

Proof. Part (i) is a part of a family of classical results related to the Marcienkiewicz- 
Zygmund strong laws of large numbers (see e.g. [251 P- 73]): it follows from a result of 
Feller [T71 Theorem 2] (see also (32J p. 253] for a more general result). Part (ii) is a 
consequence of Lemma 14. 3f ii) and the elementary bound Y^=i — max i<i<nCi- ^ 

Next we move on to some basic consequences of (AO) and (Al). Here 'i.o.' and 'f.o.' 
stand for 'infinitely often' and 'finitely often', respectively. 
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Lemma 4.5. Suppose that (AO) and (Al) hold. Let R,S C S be finite and non-empty. 
Then {X t G R i.o.} = {X t G S i.o.} up to sets of probability 0. Moreover, for any (hence 
every) finite, non-empty R C S, the following equalities hold up to sets of probability 0: 

{X t G R i.o.} = { liminf X t = 0, lim sup Ai = oo}, 
{X t eRf.o.} = { limX t = oo}. 

In particular, P [{Xt — > oo} U { liminf t -+oc X t = 0, limsup^^ X t = oo}] =1. 

Proof. Let R, S G S be finite and non-empty. Suppose that X t G i? i.o. Then, since is 
finite, there exist x G R, y G S* and stopping times ti < ^2 < • • ■ with > U + m(x, y) 
such that A ti = x and F[X tl+m ( x ^) = y | J^J > <^(x, y) > for all i, by (12. ip . Then Levy's 
extension of the Borel-Cantelli lemma (see e.g. [25| p. 131]) implies that X t = y i.o., a.s., 
giving the first statement in the lemma. Hence, a.s., either Xt G R i.o. for all finite non- 
empty R C S (including R = {0}), or for none. It follows that lim inf^^ X t G {0, oo} 
a.s., and the same fact also implies that lim sup t _ >00 X t = oo a.s. □ 

The next result says, roughly speaking, that uniformly for sites x in some interval, 
there is positive probability that, starting from that interval, the process hits x before 
leaving some larger interval. We use the notation S x :— S fl [0, x] for x > 0, 

T Xj t '■= min{s > : X t+S = x}, and a X)t := min{s > : X t+S > x}. 

Lemma 4.6. Suppose that (AO) and (Al) hold and that for some C < oo, E[A t | J~t\ < C, 
a.s., for all t G N. Let A < oo. There exist ip = <p(A) > and B = B(A, C) > A such 
that for any x G Sa, on {X t < A}, F[t x j < ctbj I Ft] > V, a -s., for all t G N. 

Proof. From ( 12. ip . writing m = max^^g^ m(x, y) and ip = mm x y( z SA ip(x, y) we have by 
(AO) and (Al) that m < oo and tp > (depending on A), and, moreover, on {X t < A}, 
for any x G Sa, ^\r x ,t ^ m I J^t] > a-s. In addition, by an appropriate maximal 
inequality [361 Lemma 3.1] and the first moment bound in the lemma, on {X t < A}, 

V[<Jhm,t < m I F t \ = P 

choosing /i sufficiently large (depending on A and C). Combining the two probability 
bounds we obtain the statement in the lemma, after a relabelling of ip/2 as ip. □ 

Recall that r n is the time of the nth return to by X, and recall that N, as defined 
just before (A3), is the first n for which r n = oo. 

Lemma 4.7. Suppose that (AO), (Al), and (A3) hold, and N = oo a.s. Then for any 
y G <S \ {0}, there exists c(y) > such that, for any n, 

F [(X t )t> Tn visits y before time r n+1 \ JF Tn ] = c(y), a.s. 

Proof. The irreducibility assumption (12.11) implies that for any n, on {r n < oo}, 

nX Tn+mm = y | JvJ > ip{0, y), a.s. (4.7) 



max > /im | J-i 



. 0<s<m 



um + n ip 
hm ~ 2 
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By the regenerative assumption (A3), P [hit y before returning to | F Tn ], on {r n < oo}, 
does not depend on n; call this probability c(y). Then, since N = oo a.s., 

oo oo 

P[eventually hit y] = P^[^J{hit y between r, and r i+1 }j < c(y) . 

t=l i=l 

Thus if c(y) = 0, the probability of eventually hitting y is also 0, which contradicts f !4.7j) 
(cf Lemma l4~5|) . Hence c(y) > 0. □ 

A recurring technical component of our proofs will be controlling the process X in 
finite intervals such as [0,x], and the exits (and overshoots) of X from such intervals. 
The following two lemmas give basic results in this direction. 

Lemma 4.8. Suppose that (AO) and (Al) hold. For any x > 0, there exists e > such 
that, for all t and for all s sufficiently large, F[a x ,t > s \ Ft] < e~ £S a.s. In particular, 
there exists K < oo, depending on x, for which E[cr x j \ Ft] < K a.s. for all t. 

Proof. Let x > and z G S, z > x. By (AO) and (Al), taking m = max y£ s x m(y, z) and 
5 = mm yeSx ip(y, z) we have m G N and 5 > 0, depending on x, such that, for any s > t, 

W[<7x,t <(s — t)+m\ JF S ] > 5l{a x , t > s - t} + l{a x ,t < s-t}, a.s. 

Taking s = t + rm for r G N yields Pfcx^ > (r + l)m | J-" t+rm ] < (1 — d)l{a x t > rm}, 
and a telescoping conditioning argument at times t, t + m, . . . , t + rm gives P[<r X)4 > rm | 
^t] < (1 — ^) r - For any s > 0, there is some r = r(s) for which rm < s < (r + l)m, so 

P[<Tx,t >s\J 7 t }< F[a x>t > rm \ T t \ < (1 - 5) r < (1 - 5)( s / m )" 1 , 

which implies the result, recalling that m and 5 depend on x but not on s or t. □ 

Lemma 4.9. Suppose that (A0)-(A3) hold, r > —1, and /ioWs with p > max{2, 1 + 
r}. Let x > 0. T/ien /or any z/ G R, there exists K < oo (depending on x) such that, on 
{X t < x}, E[f 1+rjV (X t+aX:t ) I T t ] < K, a.s. 

Proof. Under the stated conditions, Lemma 14.11 applies. In particular, ( 14. ip shows that 
for any e > there is C < oo, not depending on x, such that for s > t, 

^■[fl+r,v(X( s +l)A(t+a Xt t)) ~ fl+r,v(X sA ( t+ax t) ) \ F s ] < C(l + X s ) r_1+£ l{s ~t< CT X)t }. 

Suppose that X t < x. For t < s < t + (J x ,t, X s G [0, x], so writing b(x) = C maxj /6 5 x (l + 
yy-i+e < conditioning on Tt and taking expectations we obtain, on {X t < x}, a.s., 

s+l)/\(t+cr x ,t) 

Let u > t be an integer. Summing from s = t to u — 1 we have, on {Xt < x}, a.s., 

oo 

E[A+, ) ,(X uA(t+CT ^ () ) | F t ] < E[f 1+r , u {X t ) | F t ] + 6(:e) ^ P K* > s I ^] 



s=0 



< a(x) + b(x)E[o- X)t | 



t j 



writing a(x) = maXy^ f\ +rjV (y) < oo. The final part of Lemma l4~8l then shows that 
there is A' < oo, depending on x, for which, for all u > t, E[fi +r>l/ (X uA (t +(Tx ^) \ Ft] < K 
a.s.; letting u — > oo, Fatou's lemma completes the proof. □ 
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4.3 Proofs of main results from Section [2] 



Proof of Proposition \2.1[ The first statement of the proposition follows from Lemma 1431 
Now from part (b) of (A3) with a repeated conditioning argument, 

P[JV > k + 1] 

= F[r] k+1 < oo, 7] k < oo, . . . , r]i < oo] 

= P[%+i < oo | r fe < oo]P[r/ fe < oo | r fc _i < oo] • • -P^ < oo | rji < oo]P[r/i < oo] 
= (Pfoi < oo]) fc . 

If P[r/i < oo] < 1, this implies that N < oo a.s., so that X t = f.o., and Lemma 14.51 
shows that X t — >■ oo. On the other hand, if P[r/i < oo] = 1 we have that ¥[N > k] — 1 for 
any k, so N = oo a.s. and hence X 4 = i.o., i.e., liminf^oo X 4 = 0, cl.S., clS claimed. □ 

We now sketch the proof of Theorem 12.11 

Proof of Theorem \2.1[ Under slightly different conditions, this result follows from results 
of [301 ED El]- The results in [30J apply to a more general class of processes than we 
consider here, with a slightly stronger version of ( 12. 2p . while [31] and [3l] state their 
results in the Markovian setting, although their methods work (as in [30]) in the more 
general setting; concretely, one can use our Lemma fl~Tl (and a variant thereof for |r| = 1, 
provided by calculations similar to those in [31]) together with the results from [30] or [5J, 
for instance. These papers use a slightly different definition of recurrence to ours, but 
Lemma [4.51 shows that the definitions are equivalent under (Al). □ 

Next we give the proof of Theorem 12.21 on the tail of M\ = max 1 < s <^ 1 X s . 

Proof of Theorem \2.2\ Throughout the proof fix r > —1. First we prove the lower bound 
in ( 12. 6p . Fix v > 0. We ease notation by writing / for fi+ r ,u a s defined in Section 
14. lj for r > — 1 and v > 0, / is nondecreasing on [0, oo) and f(z) — > oo as z — > oo. 
Lemma I4TT1 implies that f(X t ) satisfies a local submartingale property; to achieve uniform 
integrability, we work with a truncated version of /, namely h x (z) := mm{f(z),f(2x)}, 
for fixed x > 0. For any e G (0, 1), on {X t < x}, for all x sufficiently large, E e (t) implies 
that X t+ i < 2x. Hence, for any e G (0, 1), on {X t < x}, 

h x (X t+1 ) - h x (X t ) > (f(X t+1 ) - f{X t )) l Ee{t) - f(X t )l{A t > (1 + Xt) 1 -"}, 

so that 

E[h x (X t+1 ) - h x (X t ) | F t ] > E [(f(X t+1 ) - f(X t )) l Ee{t) | F t ] - f(X t )F[E c e (t) \ T t \. 

By Lemma with q = 0, for e > small enough, f(X t )F[E c e (t) | T t ] = 0(A;'" 1_(e/2) ), 
a.s.; with the 7 = 1+r case of ( 14. 3 p this shows, as in the proof of Lemma H~T| on {X t < x}, 

E[h x (X t+1 ) - h x (X t ) I Ft] > {v{l +r)(s 2 /2) + o(l))Xr 1 log l/ - 1 X 4 , 

which is positive for all X t sufficiently large, since v > 0, r > —1, and s 2 > 0. Thus there 
exists A G (0, 00) such that, for all x > A, 

E[h x (X t+1 ) - h x (X t ) I Ft] > 0, on {A < X t < x} : a.s. (4.8) 
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Choose A G (0,oo) with A > max ze s A h x (z). Since f(y) — > 00 as y — > 00, we can (and 
do) choose y G <S fl (A, 00) such that /(y) > 2 A. Take x > y. Define the stopping times 

Ki := min{t G N : X t = y}, 
k 2 := min{t > K\ : X t > x}, 
k 3 := min{t > K\ : X t < A}. 

By Lemma 14.51 and the fact that for r > — 1 , X is recurrent (by Theorem 12. ip , < 00 
a.s., for each i G {1,2,3}. We consider (h x (X tAK2AK3 )) t > K1 , which is a submartingale 
by f l4.8p . Also, (h x (X tAK2AK3 )) t > K1 is uniformly integrable (since it is bounded above by 
f(2x) < 00), so h x (X tAK2AK3 ) converges a.s. and in L 1 to h x (X K2AK3 ) as t — > 00. Hence, 

2A < E[h x (X K2AK3 ) I JF K1 ] 

= E[h x (X K2 )l{K 2 < k 3 } I Fm] + E[h x (X K3 )l{K 3 < k 2 } I JF K1 \ 
< /(2x)P[k 2 < I + AP[k 3 < k 2 I 

since h x (X Kg ) < f(X K3 ) < A and h x {X K2 ) < f(2x) a.s.; re-arranging we obtain 

P[re 2 < k 3 I JF K1 ] > f ^_y a - s - ( 4 - 9 ) 
Hence, by (I4.9p . F[k 2 < k 3 \ J^J > 1/ f(3x) for all x large enough. Finally, 
F[k 2 < m } > E < Vi }F[k 2 < k 3 I J- Kl ]] > P ^ 1 , Q < , ??l] > 



/(3x) "/(4r)' 

for all x sufficiently large, by Lemma I4~T1 On {^2 < ?7i}, we have Mi = maxi< s < m X s > x. 
Thus we obtain the lower bound in ( 12. 6p . since v > was arbitrary. 

We now prove the upper bound in (12. 6p . Fix e > and now write / for / 1+r _ e . By 
Lemma I4TT1 there is A G (0, 00) such that E[f(X t+1 ) - f(X t ) \ JF t ] < on {X t > A}, a.s. 
Since r > — 1, there exists xq > A such that / is increasing on [xq, 00). Take x > x\ > xq] 
x\ will be fixed later. Define stopping times recursively by /3q := 1 and for n G N, 



In 



min{t > /? n _i : X t > Xi}, 
min{t > a n : X t < x }, 
min{t > a n : X t > x}. 



By Lemma [4.51 and the fact that X is recurrent, a n , (3 n and 7„ are a.s. finite for all n. 

By Lemma |4TT| (f(X tA p nA ^ n )) t > an is a nonnegative supermartingale, and as t — > 00 it 
converges a.s. to /(X^J). By Fatou's lemma, E[/(X^ nA7n ) | F an ] < f(X an ). Moreover, 
E[f(Xp riAln ) I Taj > P[7„ < (5 n I J r a n ]/(x), since 2 > x . It follows that for all x > x±, 

P[7n < Pn I ^aj < (4.10) 

Lemma [4.91 shows that E[/(X Qn )] < K for some K < 00 depending on xi but not on x. 
Thus taking expectations in (I4.10p we obtain, for some K < 00 and all x > Xq, 

< P n ] < K/f(x). 
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Moreover, it follows from Lemma 14.61 that we may choose X\ > xq large enough such 
that, for some S > 0, P[r/i < a n+ \ | T$^\ > 5, a.s., for all n. Thus we fix such an x\. In 
particular, we then have that P[r/i < /3 n +i I > a - s - Let «/ := min{?7, £ N : rji < j3 n }. 
Then J is stochastically dominated by a geometric random variable with parameter 5, 
and in particular P[J > n] < (1 — 5) n < e _<5n . Hence 

J k log x „ . 

P[Ml > X] < P[ |J{ 7 n < &}] < P[J > \_k\ogx\] + ^ P [7n < Pn] < ^p^, 
n=l n=l 

for some C < oo and all x > Xi, choosing k large enough. □ 

We can now state a result on the 'maximum of the maxima' in the first n excursions. 

Lemma 4.10. Suppose that (A0)-(A3) hold. Suppose that r > — 1 and A2.2\) holds with 
p > max{2, l + r}. For any e > 0, a.s., for all but finitely many n, 

7i tt^ ilogn)'^' 6 < max Mj < n^ilogn) tt^ +£ . 

l<i<n 

Proof. Apply the tail bounds in Theorem 12.21 together with Lemma 14.31 □ 

A key result for several of our remaining theorems is Lemma 14.111 It provides lower 
bounds on excursion functionals, and in particular gives a new approach to a lower tail 
bound for rji, which has advantages over previous approaches: the results in [5] are not 
as sharp, while the results in [3] require uniformly bounded increments for the process. 

Lemma 4.11. Suppose that (AO) and (Al) hold, and there exists B < oo such that 
E[Aj | J-~ t ] < B, a.s., for allt £ N, and there exist xq, c £ (0, oo) such that, on {X t > xq}, 
E[Af | J-'t] > —c/X t , a.s., for all t £ N. Let $ : S — > [0, oo) be a nondecreasing function. 
Then there exists e > such that for all y sufficiently large, 



P[Mx > y] < 2P 



in 



J2HXt)>ey 2 $(y/2) 



t=i 



In particular, P[r/i > x] > |P[Mi > (x/e) 1 ^ 2 } for all x sufficiently large. 

Proof. Let y > 2xq. Define stopping times 

Ki = min{t £ N : X t > y}; k 2 = min{t > k x : X t < y/2}. 

Note that K\ < oo a.s., by Lemma [4.5[ and {k\ < rji}, the event that X reaches [y, oo) 
before returning to 0, is J- K1 measurable. Then, for any e > 0, 

P [{«i < r)i } n {k 2 > ki + sy 2 }} = E < 7Ji}P[k 2 > ki + ey 2 \ F Kl \] . (4.11) 
We claim that we may choose e > for which, for all y sufficiently large, 

PK > ^i + ey 2 | F K1 ] > -, a.s. (4.12) 

To verify (E2]), let W t = (y - X 4 ) 2 l{A t < j/}. Then on {X t > y}, W t+1 -W t < A 2 , so 
that E[W f+ i - W t | Ft] < B, a.s., on {X t > y). On the other hand, on {X t < y}, 

W t+ i -W t < (W t+1 - W t )l{X t+1 < y} 
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< -2(j/ - X t )A t l{A t <y -X t }+ A 2 . 

Here we have that 

-2(y - X t )A t l{A t <y-X t } = -2(y - X t )A t + 2(y - X t )A t l{A t > V - X t } 

< -2(y - X t )A t + 2A 2 . 

Taking expectations we see that, on {xq < X t < y}, a.s., 



E[W t+ i - W t | T t \ < -2(y - X t )E[A t \ F t \ + 3E[A t 2 | T t ] < ^ + 35. 

In particular, there exists C < oo such that, on {X t > y/2}, JL[W t +i — W t \ Ft] < C, 
a.s. Hence we conclude that, for any t > 0, E[11/( Kl+4+ i) AK2 - W( Kl+ t)A« 2 I -^i+t] < C> a - s - 
Then an appropriate maximal inequality (Lemma 3.1 of [36]) implies that 



max W {Kl+s ) AK2 >w\J r Kl < Ct/w, a.s., 

0<s<t 



P 

using the fact that W Kl = 0. But W K2 = (y - X K2 ) 2 > y 2 /A, so 



k 2 < «i + 1 | < P max H/ (Kl+s)AK2 > (j/ 2 /4) I •Fki 



. 0<s<t 



4Crj 

— 2~) a - S '' 



and choosing t = ey 2 for e > sufficiently small (not depending on y), the claim (14.12p 
follows. Combining ( 14. lip and ( I4.12p we get 

P [{ki < 771} n {k 2 > «i + ey 2 }] > ip[«! < 77!] = ^P[M X > j/]. 

On {«i < 771} fl {^2 > K i + ^y 2 } ; > y/2 for all «i < s < k 2 , of which there are at least 
ey 2 values, all before time 771; since $ is nondecreasing we obtain the result. □ 

To obtain an upper tail bound on 771, one of the technical ingredients that we need is 
the following consequence of Theorem 2' of [1] , which extended results in [5] . 

Lemma 4.12. Suppose that (Y t ) te ^ is an (F)^- adapted stochastic process on an un- 
bounded subset of [0, 00). Let Ta '■— min{r; G N : Yt < A}. Suppose that there exist p > 0, 
v G R, and 5 > such that 

E[Y t % log" Y t+l - Y 2p log" Y t I Ft] < SY 2p ~ 2 log^ 1 Y t , on {T A > t}. (4.13) 

Then for some C < 00, P[T^ > x \ Y\ = Xq] < C x~ p (log x) p ~" x\f {log Xq)" . 

Proof. We apply Theorem 2' of [I] with, in the notation there (but with time denoted 
by t rather than n) X t = Y t , h(x) = x 2p (logx)", U t = h(Y t ), g(x) = x 2p_2 (logx) !y " 1 , and 
f(x) = x p (logx) q , where p > and v G R are as in the statement of the lemma and 
q G R is to be chosen later. It follows from Theorem 2' that, under the conditions of the 
lemma, for some C < 00, for any xq > A, 

E[f(T A ) I Y 1 = x ] < Ch(x ) = Cx 2 p (logx y, (4.14) 

provided that, writing / _1 here for the inverse function of /, 

liminf ( _— lfcL_ ) > 0. (4.15) 



x- 



*» \Hf-Hh(x))) 
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We verify (14.151) for the stated /, g, h. We claim there exists c G (0, oo) such that 

f-\ x ) = ( c + (l))x 1/p (log x)~ q/p . (4.16) 

Since / is eventually increasing, to verify (I4.16P it suffices to show that, for an appropriate 
c G (0, oo), /((c + e)x l / p i\ogx)~ q / p ) is eventually greater than x if e > but eventually 
less than x if e < 0. But we have, for a > 0, 

/(ax 1/,p (logx) _l?//p ) = a p x(\ogx)~ q [log a + p~ l logx — (g/p) log log x] 9 
= (« p p-« + o(l))x, 

which satisfies the desired properties with a = c provided c p p~ q = 1, i.e., c = p q l p . Thus 
we obtain (I4.16p . It follows that, for some d G (0, oo), 

f-\h{x)) = (c' + o(l))x 2 (logx)^. 
Now f'(x) = (p + o(l))x p_1 (logx) 9 , so we get, for some c" G (0, oo), 

f\r\h{x))) = (c" + o(i))x 2p - 2 (\o g xy + ^. 

Then (14.151) holds provided that s — 1 — [y + > 0, that is, q < v — p. This shows 
that (I4.14p holds, and then the result of the lemma follows by Markov's inequality. □ 

Now we can complete the proof of our main result on the duration of an excursion. 

Proof of Theorem \2.3[ First we prove the upper bound in (12.71) . Our starting point will be 
Lemma I4.12[ which deals with the hitting time of a suitably large interval [0, ^4] starting 
from outside that interval. Some additional work, based on the irreducibility assumption, 
is needed to relate this to the return time t]i to 0. Fix A > and B > A (to be specified 
later). Define stopping times «j and recursively by (3q := 1 and for n G N, 

a n := min{£ > /3 n _i : X t < A}, (3 n := min{t > a n : X t > B}; 

by Lemma [4.51 and the fact that X is recurrent, a n < (3 n < oo for all n, a.s. 

We have from the 1 + r = 2p case of (144|) that with Y t = X t , f 2 p, v {X t ) satisfies (I4.13P 
taking 2p = 1 + r > and v < 0, provided the A in (I4.13P is large enough. Thus take A 
to be sufficiently large. Hence we can apply Lemma [4. 121 to show that, for any e > 0, 



K+l -Pn>x\ 7>J < X 2 r (l0gx) 2 ,+£ (l+X^ 



\l+r 



for all x large enough. Here the v = case of Lemma [4.91 shows that E[(l + Xp n ) 1+r ] < 
K < oo for K not depending on x. So taking expectations in the last display, we obtain 

P[a n+ i - p n > x] < x-^ihgx)^, (4.17) 

for all x sufficiently large. On the other hand, for B = B(A) as in Lemma [4.6[ we have 
that for ip > 0, for all n, P[t/i < j3 n \ F an ] > <p, a.s. Let K := min{n : j3 n > r)i}. Then 
K is stochastically dominated by a geometric random variable with parameter ip, and in 
particular F[K > n] < (1 — ip) n < e"^". Moreover, r)i < X^=i( a n+i — a n)- So 



r- k log X 



P[t7! > x] < F[K > [k\ogx\] + P 
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n=l 



< x~ {l+r) + k(\ogx) supP 



X 



klogx 



(4.18) 



choosing k sufficiently large. A similar argument to Lemma [4.81 shows that P[/3 n — a n > 
x] < e~ cx for c > depending on B (and hence on A). Then since 

F[a n+l - a n > x] < ¥[a n+1 - p n > x/2] + P[/3 n - a n > x/2], 

it follows that a n+ \ — a n satisfies the same tail bound (14.171) as a n+ i — (3 n . The upper 
bound in (12. 7p then follows from (I4.18p . 

The lower bound in (12.71) follows from the final statement in Lemma 14.111 together 
with the lower bound in Theorem 12.21 □ 

Now we can give a result on the total duration of the first n excursions. 

Lemma 4.13. Suppose that (AO), (Al), (A2), and (A3) hold. 

(i) Suppose that — 1 < r < 1 and h2.2\) holds with p > 2. Then for any e > 0, a.s., for 
all but finitely many n, 



2 2 X ^ 2 , 6+2i 

n !+'• (log n) !+*• < y^f]i < n 1 + r (iogn) 1 + r 



i=l 

(ii) Suppose that r > 1 and \2.2\) holds with p > 1 + r. Then as n — > oo, a.s., 
n ~ X YJU Vi -> G (0,oo). 

Proof. Part (ii) follows from the strong law of large numbers since E^] < oo for r > 1, 
by Theorem 12.31 while E[^i] ^ since rji is nondegenerate. Now suppose that r G (—1, 1]. 
The lower bound in (i) follows from the lower bound in (12. 7p with Lemma [4.4f ii). while 
the upper bound in (i) follows from the upper bound in (12.71) with Lemma 14. 4l (i). □ 

An inversion of the previous result enables us to complete the proof of our theorem 
on the number of excursions. Recall that N t = max {n G N : Y^i=i — 0- 



Proof of Theorem\2.4\ For part (i), fix e > 0. From the lower bound in Lemma [4.13( i). 



we may choose e' > small enough for which, a.s., for all t large enough 

[^(log*)^] 

5^ Vi > t(\ogt)^- £ ' > t, 

i=l 

giving the upper bound in (12. 8p . The lower bound in (I2.8P follows similarly from the 
upper bound in Lemma 14. 13( i). Part (ii) follows from Lemma 14. 13( ii). □ 

Next we turn to our results on stationary distributions. 

Proof of Theorem \2.5[ We verify the claimed properties of 7r defined at (I2.10p . When 
r > 1, we have from Theorem l2.3l that E[r/i] G (0, oo). Since, for any x, < i\{x) < f]i a.s., 
it follows that E[£i(x)] < oo for all x G S. It is clear that 7r(x) > and J2 x es n ( x ) = 1- 
To show that 7r(x) > 0, it suffices to show that E[£i(x)] > 0. Suppose that, for some 
x G S, £\(x) = a.s. Then by (A3), L t (x) = a.s. for all t. But this contradicts Lemma 
1431 So P[£i(x) > 0] > 0, which implies E[4(sc)] > 0. 
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Next, note that for any x G S, a.s., Yln=i^ri{x) — L t (x) < Yln=i ^n(x). Here 
(4(^))neN are i.i.d. random variables with finite means, and so it follows from the strong 
law of large numbers that Nf 1 L t (x) — > K[£i(x)] a.s. for N t — > oo, which with Theorem 
I2.4( ii) implies that t~ l L t (x) — > a ' s '' anc ^ ^ ne conver g ence follows from the 

bounded convergence theorem. Finally the convergence of ¥[X t = x] to ir(x) follows from 
e.g. (21 Corollary VI. 1.5, p. 171] under the additional 'aperiodicity' condition. □ 

The proofs of our remaining theorems now involve combining our previous results. 

Proof of Theorem \2.b\ We have that for any t G N, 

max Mi < maxl s < max M». (4.19) 

l<i<N t l<s<t l<i<N t +l 

The result follows from Theorem 12.41 and Lemma [4. 101 together with (14.191) . □ 

Proof of Theorem \2. 1\ Fix a > and r > — 1. First we prove the upper bound in ( I2.12p . 
Clearly £^ < r\\M^. It follows that, for any x > 1, 

F[^[ a) >x}< P[{r/i > x^(logx)^} U {Mi > x^(logx)"^ }] 
< P[?7i > x^ (logx)^] + P[Mi > (logx)"^]. 

Now applying the upper bounds from (12. 7p and (12.61) we obtain the desired upper bound. 

Next we prove the lower bound in (12.121) . It follows from the = x a case of 

Lemma [4. 1 II that there exists C G (0, oo) such that, for all x large enough, 

P[d a) > x] > -P[Mi > Ci^]. (4.20) 
The lower bound in ( 12. 12j) now follows from (I4.20p and the lower bound in ( 12. 6p . □ 

Recall that of } = YLi^f, so = Eti& ] - 

Lemma 4.14. Suppose that (A0)-(A3) hold. Suppose that r > — 1 and $2.2}) holds with 
p > max{2, 1 + r}. Let a > 0. 

(i) Suppose that —1 < r < 1 + a. Then for any e > 0, a.s., for all but finitely many n, 

a + 2 a + 2 , \ a + 2 2q + 4 , r> , 

ni+r- (logn) < S 1 ;^ < n 1 + r (logn) 1 + r . 

Suppose that r > 1 + a. Then as n — > oo ; a.s., 

n" 1 ^ ^E[d a) ] =EM5> Q vr(x) G (0 )O o), (4.21) 

where ir is given by 112.10}) . 

Proof. First we prove part (ii). For r > 1 + a, E[£^] < oo by Theorem 12.71 Then, by 
(12. lip . E[£f^] = ^2 x£S x a K[£i(x)], so, by (I2.10p . the two expressions for limiting constant 

in (14.211) are indeed equivalent. Also, E[£^] > since, by Theorem 12.51 ir(x) > for all 
x G <S. The convergence in (14.211) follows from the strong law of large numbers. 

Now for part (i), suppose that r G (— l,a + 1]. Then the lower bound in part (i) 
follows from the lower bound in (12.121) and Lemma I4.4( ii). The upper bound in part (i) 
follows from the upper bound in (12.121) and Lemma I4.4f i). □ 
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Proof of Theorem \2.8l By definition of and N t , for any t & N, 

gg) < sf) < (4.22) 

For — 1 < r < 1 + a, we have from Lemma BUD ^i) with (I4.22p that for any e > 0, a.s., 
for all but finitely many t, 

Np(logt)-^- e < sf > < (N t + l)^(log*)^ +2+e , (4.23) 

using the fact that N t < t a.s. to obtain the logarithmic terms. Now from (I4.23P we 
obtain part (i) of the theorem by applying the bounds for N t in Theorem I2.4( i) and we 
obtain part (ii) of the theorem from Theorem I2.4f ii). 

Finally, suppose that r > 1 + a. We have from (14.221) that 

(t- l N t )N t - l S% < r 1 ^ < (t-\N t + l))(N t + 

Both t~ l N t and t~ 1 (N t + 1) converge a.s. to Efr/i] -1 by Theorem I2.4l (ii). while Lemma 
14. 14( ii) and the fact that Nt — > oo a.s. as t — > oo imply that both N^S^ and (Nt + 
1) -1 jS^ +1 converge a.s. to Ef^j ^]. Hence we obtain the first limit statement in ( 12.1 3ft : 
for the subsequent equality in ( I2.13P we use the expression for E[^ a) ] given in (I4.2ip . □ 



5 Proofs for Section 3 



5.1 Proofs for Section 13.1 



In this section we prove our results on processes on the whole real line. The proofs use 
the same ideas as those for our results from Section [21 so we do not dwell on the details. 

Proof of Theorem \3.1[ We again use To,t±,... to denote the times at which X t = 0, 
and t] n := r n — T n -\. Conditions (BO) and (Bl) ensure that r]i,r] 2 , . . . are i.i.d., and rji 
has the same distribution as + r] + + Q_r\_ + (1 — 9 + — 9_), where 6 + := 1{X 2 > 0}, 
0- := 1{X 2 < 0} and (by (B2)) 7]± is the return time for a half-line model of Section 
|2] with r = r±, independent of 9 + and 9-. Since — 1 < r + < r_ < 1, and E[0±] > 0, 

l + r_|_ 

it follows from Theorem 12.31 that P[?yi > x] = x 2~ hence the process is null- 
recurrent. By a similar argument to Theorem 12.41 since each excursion takes either sign 

l+r_|_ 

with uniformly positive probability, there are t~ i-'w) excursions of each sign by time 
t, where the notation e t = o u (t) means that the (random) sequence e t satisfies e t — > 0, 
a.s., as t — > oo (in other words, o w (t) is an extension of the Landau o(l) notation in which 
the implicit constants are allowed to depend on the probability space element u). The 
result then follows as in the proof of Theorem 12. 6[ using Lemma 14.101 □ 

Proof of Theorem \3.2 . Again, we use the fact that the numbers of positive or negative 

l-[-r_|_ 

excursions up until time t are both t~ ^M 1 )^ a s Then Lemma [4.141 and an argument 
similar to the proof of Theorem 12.81 applied separately to the positive and negative parts 

^]* =1 X+ and ^]* =1 X s " shows that, a.s., the latter is t 2 1+r - +0uj ^ while the former is 
which therefore dominates the asymptotics, yielding the result. □ 
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5.2 Proofs for Section 13.2 



We write ei, . . . , for the standard orthonormal basis of M. d , and for vectors u, v G M. d 
we use u • v to denote their scalar product. 

Proof of Theorem \3.3[ Suppose that (CO) holds. Take T t = 0"(£i,£ 2) ■ ■ ■ = ll&ll' 

and S = {||x|| : x G S} C [0, oo). Then G S since 6 E, and, by local finiteness of E, 
{x G S : ||x|| = x} is finite for any x G S. Hence (AO) follows. Next we verify (Al). By 
irreducibility of S, for any x, y G S, there exist fc(x, y) G N and k(x, y) > such that 



P[6+fe(x,y) = y | & = x] = «(x, y) > 0. Let x = ||x|| and y 

p [At+fcfe, y ) = y | Ft] = y) 

> min{«;(x, y) : x G S, ||x|| = 



|y||, so x, y G S. Then, a.s., 



Mtl yeS, ||y|| = y}; 



denote this last quantity <£>(||£t||, y). Then <£>(||£t||, y) > by the finiteness of the sets over 
which x and y run. We choose y with ||y|| = y, and for that y take m(||£ t ||, y) = k(£ t , y) < 
oo. This shows that (Al) holds. Moreover, (A3) follows from the fact that H is an 
irreducible Markov chain. Also, by the triangle inequality, \X t +i — X t \ = \ \\£t+i II — \\Ct\\ | < 
||£t+i — £t||, so if (13. 3p holds for some p > 0, then so does (12.21) . 

It remains to show that (CI) implies (A2). Let 7 G (0, 1), to be chosen later. We will 
estimate the increment + 9 t \\ — \\£ t \\ by Taylor's theorem in R d . First observe that 



d_ 

dxi 



(J 1 



1{* = 3} 



0C %iC j 



dxidxjdxk 



0{ 



|-2> 



Then by Taylor's formula, for any x G M. d , 



1(119,11 < 



Mr>=E 



x 1 
|x 



■e i )l{||e f || < ||x|P} 



1 d 



i=l 



1 

|x| 



x 



1^11 < 



i-1 



Z^|| 

i=2 3=1 " 

o(\\e t f\ 



eO(^-e,)l{||^ 



< 



< 



'})■ 



(5.1) 



We will condition on £ 4 = x and take expectations in (15. ip . To this end, note that 



E[||fl t || 3 ||x||- 2 l{||fl t || < ||xf } I £t = x] < ||x|r 2 E[||0 t || 2 I 6 = x] = 0(||x| 



In addition, for q G [0,2] a similar argument to Lemma [4.21 shows that, for some e > 
and 7 close enough to 1, 



E[(0 t .e i ) ff l{||0 t ||>||xf}|et = x] = O(||x| i 
The g = 2 case of (15.21) . with the Cauchy-Schwarz inequality, shows that 
E[(9 t ■ ei){9 t ■ e,)l{\\9 t \\ > ||x|n | & = x] = 0(||x||- £ ). 



(5.2) 



Also, we have from (CI) that 



E[0t • ei j £ t = x] = ei • /i(x) 



pXi 



+ 



-Mog" 1 
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E[(6 t ■ ei)(6t ■ ej) \ & = x] = M^x) = a 2 l{i = j} + oQog- 1 ||x 
Combining these estimates, taking expectations in (15. ip yields 
E[(||x + e,||-||x||)l{||9,||<||x|r}|6=x] 

II II ,_i \ II II II II / 



1=1 11 11 1=1 



odixy-Mog- 1 ||x| 



On the other hand, by the triangle inequality, 

E [|||x + t || - ||x||| l{||0 t || > ||x|n I 6 = x] < Ep t ||l{||0 t || > ||x|r}] , 

which, for 7 close enough to 1, is also o(||x|| -1 log -1 ||x||) by another application of (15.21) . 
Thus we have shown that 

E[X t+1 - X t I 6 = x] = (p + y (d - 1)) Hxir 1 + odlxll" 1 log^ 1 ||x||), (5.3) 

which implies that (E3J) holds with c = p + (d - l)(a 2 /2). 

For the second moment estimate, observe that, given £ f = x, 

(X t+l -X t ) 2 = ||x + t f- ||x|| 2 -2||x||(||x + t || - ||x||) 



^H 2 + 2x-^-2||x||(X m -Xi). (5.4) 
Here we have that 

d 

E[\\6 t \\ 2 + 2x • 6 t I & = x] = J2 M «( x ) + 2x • M x ) = rfff2 + 2p + o(log" 1 ||x||). (5.5) 

i=l 

Taking expectations in (15.41) . using (I5.5P and (15.31) . we obtain 

E[{X t+1 - X t ) 2 I 6 = x] = da 2 + 2p - 2{p + (d- l)(a 2 /2)) + o(log^ ||x||), 
which, after simplification, shows that (12.41) holds with s 2 = a 2 . □ 

5.3 Proofs for Section ET51 

First we prove the following analogue of Lemma 7.6 of [9]. As in [9], we relate the general 
version of Z t to the special case in which k = a.s., which we denote here by Z[. By 
construction, for x, y G N, 

P[Z m = y I Z t = x] = E [P[Z; +1 =y\Z' t = x- min{ K , z - 1}]] . (5.6) 

Write A := Z t+1 - Z t . 

Lemma 5.1. For any e > 0, as x — > 00, 

P[|A| > x {l/2)+£ \Z t = x}= 0(exp{-x e/3 }). (5.7) 
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Also, for any r £ N there exists C < oo /or which, for all x £ N, 

E[| A| r I 2"t = x] < Cx r/2 . 

Moreover, as x — > oo, 

E[A | Z t = x] = H - E[k] + o(log- 1 x), (5.8) 
E[D t 2 | Z t = x] = ^x + o(xlog _1 ar). (5.9) 

Proof. The proof is similar to that of Lemma 7.6 in [9]; we sketch the differences, which 
are due to the fact that we use (15 .6p in place of the final statement of Lemma 7.5 in [9]. 
Write D' t := Z' t+l — Z[. Lemma 6.4 in [9] says that, for a given a > 0, 

E[D' t \Z' t = x] = ^ + 0(e- a n- (5-10) 

We also note that, by Markov's inequality and our tail assumption on k, there is C < oo 
for which, for all r > 1, 

P[|«| > r] < Ce~ Xr . (5.11) 
We prove (15.71) . By (15.61) . for any e > 0, and any x > 1, 

P[|A| >r\Z t =x}< F[\k\ > x £ ] + sup P[|£>;| > r - x £ \ Z' t = x}. 

y.\x-y\<x e 

Taking r = x^ l ^ 2 ^ +e , using (15.111) and the tail bound for D' t given in Lemma 6.3 of [9], we 
verify (1577ft . For (j578"j) . it follows from <^M> that 

E[A \Z t = x] = -E[min{K, x — 1}] + E [E[£>; | Z t ' = x - «]] . 

Here, as in the proof of Lemma 7.6 in [9], E[min{/t, x — 1}] = E[k] + 0(exp{— Ax/2}). 
Also, using the fact that sup^EfD^ | Z[ = x] < C < oo by (15.101) . we have 

E [E[D' t \Z' t = x- k]] < C¥[\k\ > ^x]+ sup E[D' t \ Z' t = y], 

y:\y-x\<y/x 

which with ( 15 . 1 0[) and (15. lip gives the upper bound in (15. 8p . a similar argument yielding 
the lower bound. Similar variations of the arguments in the proof of Lemma 7.6 of [9] 
give the remaining parts of the lemma. □ 

Proof of Proposition \3.1[ Proposition 13.11 follows from Lemma 15.11 in exactly the same 
way as Lemma 7.7 in [9] follows from Lemma 7.6 there. □ 

Proof of Theorem \3.4\ We proceed as in the proof of Theorem 2.6 of [9], but instead 
of Lemma 8.3 in [9], we apply our sharper Theorem 12.71 The details involve minor 
modifications to the arguments in [9]. Here we merely give some intuition as to why ^\ 
appears. The key fact is that, ignoring the jumps driven by k, the original process takes 
Z t + Zt+i steps to traverse the quadrant between times v t and vt+u the correction to this 
due to the jump of size K t is small. Hence over one excursion of the embedded process 
X t = \[Z t — 1, the original process accumulates time r ~ "Y^t=i-^ti which is exactly of 
the form of the excursion sum □ 
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